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Abstract 

We show a direct product result for two-way public coin communication complexity of all 
relations in terms of a new complexity measure that we define. Our new measure is a gen- 
eralization to non-product distributions of the two-way product subdistribution bound of J., 
Klauck and Nayak [JKN08 , thereby our result implying their direct product result in terms of 
the two-way product subdistribution bound. 

We show that our new complexity measure gives tight lower bound for the set-disjointness 
problem, as a result we reproduce strong direct product result for this problem, which was 
previously shown by Klauck |Klal0j . 

1 Introduction 

Let fCXxyxZbea relation and e > 0. Let Alice with input x G X , and Bob with input 
y € y, wish to compute a z € Z such that (x, y, z) € /. We consider the model of public coin 
two-way communication complexity in which Alice and Bob exchange messages possibly using 
pubic coins and at the end output z. Let Rg' pub (/) denote the communication of the best protocol 
V which achieves this with error at most e (over the public coins) for any input {x,y). Now 
suppose that Alice and Bob wish to compute / simultaneously on k inputs (x\, j/i), . . . , (xk,yk) 
for some k > 1. They can achieve this by running k independent copies of V in parallel . 
However in this case the overall success could be as low as (1 — e) k . Strong direct product 
conjecture for / states that this is roughly the best that Alice and Bob can do. We show a 
direct product result in terms of a new complexity measure, the e error two-way conditional 
relative entropy bound of /, denoted crent^(/), that we introduce. Our measure crent|(/) forms 
a lower bound on R^' pub (/) and forms an upper bound on the two-way product subdistribution 
bound of J., Klauck, Nayak [JKN08] , thereby implying their direct product result in terms of 
the two-way product subdistribution bound. 

As an application we reproduce the strong direct product result for the set disjointness 
problem, first shown by Klauck KlalO . We show that our new complexity measure gives tight 
lower bound for the set-disjointness problem. This combined with the direct product in terms 
of the new complexity measure, implies strong direct product result for the set disjointness 
problem. 
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There has been substantial prior work on the strong direct product question and the weaker 
direct sum and weak direct product questions in various mo dels of communication complex- 
ity, e.g. |IRW94[ IPRW971 ICSWY01I ISha031 IJRS031 lKSdW04l IKla041 IJRS05I IBPSW07I IGav08l 
IJKN081 [JKMl IH.IMR09I TBBR10I iBRlOl IKlalOj . 

In the next section we provide some information theory and communication complexity 
preliminaries that we need. We refer the reader to the texts |CT 91 , KN97J for good introductions 
to these topics respectively. In section[3]we introduce our new bound and show the direct product 
result. In section [4] we show the application to set disjointness. 

2 Preliminaries 

Information theory 

Let X, y be sets and k be a natural number. Let X k represent X X • • • X X, k times. Let /i be 
a distribution over X which we denote by fx £ X. We use /j,(x) to represent the probability of 
x under [i. The entropy of /j, is defined as S{jx) = — J2xex ^( x ) l°gM( 2: )- Let X be a random 
variable distributed according to /i which we denote by X ~ /i. We use the same symbol to 
represent a random variable and its distribution whenever it is clear from the context. For 
distributions n,fii £ X, \i ® [i\ represents the product distribution (jx ® Pi){x) — fj,(x) ® pi{x) 
and fi k represents fj, ® • • • ® fj,, k times. The l\ distance between distributions [i, (ii is defined as 
\\fJL — fii\\i = \ J2xex \ v( x ) — ^i( x )\- Let X, p £ X x y. We use n(x\y) to represent /j,(x, y)/fi(y). 
When we say XY ~ /i we assume that X £ X and Y £ y. We use fi x and Y x to represent 
Y\ X — x. The conditional entropy of Y given X, is defined as S(Y\X) = E x +_xS(Y x ). The 
relative entropy between A and \i is defined as S(\\\p) = J2 x ex H x ) 1°§ jjfey • We use the 
following properties of relative entropy at many places without explicitly mentioning. 

Fact 2.1 1. Relative entropy is jointly convex in its arguments, that is for distributions 

Al, A2, fll, [12 

S( P X 1 + (1 - p)A 2 || pm + (1 - p)na) < P ■ SiXxWtix) + (1 - p) ■ S(X 2 \\fx 2 ) ■ 

2. Let XY, X X Y X £ X x y. Relative entropy satisfies the following chain rule, 

SiXYWX^ 1 ) = SiXWX 1 ) +E X ^ X S(Y X \\Y X 1 ) . 
This in-particular implies, using joint convexity of relative entropy, 

SiXYWX 1 & Y 1 ) = SiXWX 1 ) +E X ^ X S(Y X \\Y 1 ) > S&WX 1 ) + S(Y\\Y l ) . 

3. For distributions A,/i : ||A — n\\i < y/ S(X\\fi) and S(X\\fi) > 0. 

The relative min-entropy between A and u is defined as 5oo(A||/i) = max x£ x log ^rr- It is 
easily seen that S(A||/i) < S 00 (X\\fi). Let X, Y, Z be random variables. The mutual information 
between X and Y is defined as 

I[X : Y) = S{X) + S(Y) - S(XY) = E X ^ X S(Y X \\Y) = E y ^ Y S{X y \\X). 

The conditional mutual information is defined as I(X :Y\Z)= E z ^zI(X :Y\Z = z). Random 
variables XYZ form a Markov chain Z X <- Y iff I(Y : Z\ X = x) = for each x in the 
support of X. 
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Two-way communication complexity 

Let / C XxyxZ be a relation. We only consider complete relations, that is for all (x, y) £ Xxy, 
there exists a z £ Z such that (x, y, z) £ f. In the two-way model of communication, Alice with 
input x £ X and Bob with input y £ y, communicate at the end of which they are supposed to 
determine an answer z such that (x, y, z) £ f. Let e > and let \i £ X x y be a distribution. 
We let D^'' 1 (/) represent the two-way distributional communication complexity of / under \jl 
with expected error e, i.e., the communication of the best deterministic two-way protocol for 
/, with distributional error (average error over the inputs) at most e under fi. Let Rg' pLjb (/) 
represent the public-coin two-way communication complexity of / with worst case error e, i.e., 
the communication of the best public-coin two-way protocol for / with error for each input (x, y) 
being at most e. The following is a consequence of the min-max theorem in game theory [KN97, 
Theorem 3.20, page 36]. 

Lemma 2.2 (Yao principle) Re' pub (/) = max M D^(/). 

3 A strong direct product theorem for two-way commu- 
nication complexity 

3.1 New bounds 

Let fCXxyxZbea relation, /i, A £ X x y be distributions and e > 0. Let XY ~ /j, and 
X\Yi ~ A be random variables. Let S C Z. 

Definition 3.1 (Error of a distribution) Error of distribution /x with respect to f and an- 
swer in S, denoted err/ i g(/Lt), is defined as 

err/, s (/x) d = min{ Pr [(x,y,z) <£ f] | z £ S} . 

Definition 3.2 (Essentialness of an answer subset) Essentialness of answer in S for f 
with respect to distribution fi, denoted ess M (/, S), is defined as 

ess A '(/, S) = 1 — Pr [there exists z (£ S such that (x, y, z) £ /]. 
For example ess M (/, Z) = 1. 

Definition 3.3 (One-way distributions) A is called one-way for fi with respect to X, if for 
all (x,y) in the support of A we have n(y\x) — X(y\x). Similarly A is called one-way for /j, with 
respect to y, if for all (x,y) in the support of X we have [i(x\y) — X(x\y). 

Definition 3.4 (SM-like) A is called SM-like (simultaneous-message-like) for \i, if there is a 
distribution 9 on X x y such that 6 is one-way for /x with respect to X and X is one-way for 6 
with respect to y. 

Definition 3.5 (Conditional relative entropy) They -conditional relative entropy of X with 
respect to fi, denoted crent^(A), is defined as 

crent£(A) d = E y ^ Yl S((Xi) y \\X y ). 

Similarly the X -conditional relative entropy of X with respect to fi, denoted crent^(A), is defined 
as 

crent£(A) d = E^ 1 5((y 1 ) :c ||y x ). 
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Definition 3.6 (Conditional relative entropy bound) The two-way e-error conditional rel- 
ative entropy bound of f with answer in S with respect to distribution /i, denoted crent 2 '^/, S), 
is defined as 

crentg' /i (/, S) d = min{crent^.(A) + crent^(A) | A is SM-like for fi and err/ j ,s(A) < e} . 
The two-way e-error conditional relative entropy bound of f, denoted crent 2 (/), is defined as 

crent 2 (/) = max{ess"(/, S) ■ crent^(/, S) \ fi is a distribution over X x y and SCZ} . 

The following bound is analogous to a bound denned in [JKN08] where it was referred to as 
the two-way subdistribution bound. We call it differently here for consistency of nomenclature 
with the other bounds. [JKN08 typically considered the cases where S = Z or S is a singleton 
set. 

Definition 3.7 (Relative min entropy bound) The two-way e-error relative min entropy 
bound of f with answer in S with respect to distribution fi, denoted ment 2,A1 (/, S), is defined as 

ment 2,A1 (/, S) d = min{S' 00 (A| |/i)| A is SM-like for fi and err/.s(A) < e} . 
The two-way e-error relative min entropy bound of f, denoted merit 2 (/), is defined as 

ment^(/) = max{ess"(/, S) ■ merit*'" (/, S) \ [i is a distribution over X x y and S C Z} . 

The following is easily seen from dehnitions. 
Lemma 3.1 

crent^(A) + crent^,(A) < 2 ■ Soo(A||/x) 

and hence 

crent 2 ^(/, S) < 2 ■ ment^(/, S) and crent|(/) < 2 ■ ment 2 ^/). 

It can be argued using the substate theorem }JRS02| (proof skipped) that when /i is a product 
distribution then merit 2 '^/, S) — 0(crent e '%(f, S)). Hence our bound crent 2 (/) is an upper 
bound on the product subdistribution bound of JKN08 (which is obtained when in Defini- 
tion 13.71 maximization is done only over product distributions fi) . 

3.2 Strong direct product 

Notation: Let B be a set. For a random variable distributed in B k , or a string in B k , the 
portion corresponding to the ith coordinate is represented with subscript i. Also the portion 
except the ith coordinate is represented with subscript —i. Similarly portion corresponding to 
a subset C C [k] is represented with subscript C. For joint random variables MN, we let M n 
to represent M\ (N = n) and also MN\ (N = n) and is clear from the context. 
We start with the following theorem which we prove later. 

Theorem 3.2 (Direct product in terms of ment and crent) Let f C X x y x Z be a rela- 
tion, fi £ X x y be a distribution and S C Z. Let 0<£<l/3, 0< 2005 < 1 and k be a natural 
number. Fix z e Z k . Let the number of indices i € [k] with Zi G S be at least 5ik . Then 

ment 2 ^ k {1 _ £/2)l66iki (f k ,{z}) > S ■ S 1 ■ k ■ crent^(/, S) . 

We now state and prove our main result. 
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Theorem 3.3 (Direct product in terms of D and crent) Let / C X x y x Z be a relation, 
fi G X x y be a distribution and S C Z. Let < e < 1/3 and k be a natural number. Let 
S 2 = ess»(f, S). Let < 200<5 < S 2 . Let 5' = 3(1 - E /2)^fc/2j . Then, 

D?i(/*) > 5 • 5 2 • • crent 2 ^/, S) - k . 

Proof: Let crent^ e (/, S 1 ) = c. For input (x,y) G A"* 1 x y k , let b(x,y) be the number of indices 
i in [k] for which there exists z% (£ S such that (xi, yi, z%) G /. Let 

B = {(x,y) G X k x 6(a;,y) > (1 - 5 2 /2)fc}. 

By Chernoff's inequality we get, 

Pr \{x,y) €B] < exp(-<5 2 2 fc/2). 

(x,y)<-iJ, k 

Let be a protocol for f k with inputs ~ with communication at most d = (kcSS2/2) — k 
bits. Let M £ M represent the message transcript of V . Let 

B M = {meM\ ¥r[{XY) m G B] > exp(-<5 2 fc/4)}. 

Then Pr[M G B M ] < cxp(-<5|fc/4). Let 

Bit = {meM\ Pr[M = m] < 2- d ~ k }. 

Then Pr[M G B\f] < 2~ k . Fix m </ B^r U B^. Let z m be the output of V when M = m. 
Let b(z m ) be the number of indices i such that z m ^ ^ 5. If b(z m ) > 1 — <$2&/2 then success 
of V when M = m is at most exp(-<5ffc/4) < (1 - e/2) _ If b ^ < x _ then 

from Theorem 13.21 (by setting z = z m and Si — S2/2), success of V when M = m is at most 
(1 — e/2) L**a*/ 2 J . Therefore overall success of V is at most 

5' = 2- k + cxp(-^fc/4) + (1 - 2- k - exp(-^Jfe/4)(l - e /2)L Ma */aJ 
< 3(1 - e /2)L 44afc / 2 J. 



Proof of Theorem 13. 21 Let c = crent 2 ^(/, S). Let A G X k x ^ be a distribution which is 
SM-like for /x fc and with Soo(A||// fe ) < <W x cfc. We show that err /Mz} (A) > 1 - (1 - e/2) L Wl *J . 
This shows the desired. 

Let XY ~ A. For a coordinate i, let the binary random variable Tj G {0,1}, correlated 
with JY, denote success in the ith coordinate. That is 2j = 1 iff XY = (x,y) such that 
(xi,yi,Zi) G /. We make the following claim which we prove later. Let kl — \ b~b~\k\. 

Claim 3.4 There exists k' distinct coordinates i\, . . . ,ik' such that Pr[T^ = 1] < 1 — e/2 and 
for each r < k' , 

1. either Pr[T n xT is x-xT ir = l]<(l- e/2) fc ' , 

2. or Pr[T lr+1 = 1| (T n x T l2 x ■ • • x T ir = 1)] < 1 - e/2. 
This shows that the overall success is 

Pr[Ti x T 2 x ■ ■ ■ x T k = 1] < Pr[T n x T l2 x ■ • • x T ly =1]<(1- e/2) fe ' . 
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Proof of Claim 13. 4t Let us say we have identified r < k' coordinates ii,...i r . Let C — 
{h,i 2 , • • • , i r }- Let T = Ti x T 2 x ■ ■ ■ x T r . If Pr[T = 1] < (1 - e/2) k ' then we will be done. 
So assume that Pr[T = 1] > (1 - e/2) k ' > 2- 55lk . Let X'Y' ~ fj,. Let X X Y X = (XY\ T = 1). 
Let D be uniformly distributed in {0, l} k and independent of X 1 Y 1 . Let Ui — X\ if Di = 
and = 1^ if -Di = 1. Let [/ = U\ . . .Uk- Below for any random variable XY, we let XYd, u , 
represent the random variable obtained by appropriate conditioning on XY: for all i, Xi = Ui 
if di = otherwise Yi = Ui if d = 1 . Let I be the set of indices i such that zi <E S. Consider, 

ddik + ss lC k > s 00 pr 1 y 1 ||.yy) + s^XYWix'Y')^) 

> Sooix^Wix'Y')^) > s , (x 1 r 1 ||(x'y')® fe ) = E d ^ jD s , (x 1 r 1 ||(x'r')® fc ) 

> ^{d,u,xc,yc)^{DUX 1 c Y^)S{{X 1 Y 1 )d,u,x c ,yc \\{{X'Y')® k )d,u,x c ,yc) 

> ^(d,u,x c .,y c )^(DUXl.Yl.)S(X} u xc y J\X' dl Ul Xc yc <g> . . . <g) X' dk Uk Xc yc ) 

> ^(d,u,x c ,yc)^(DUX^Y l l) , 5'((^l«,x c , ! y c )i||^d I ,u l ) 

= ^(d,j 1 ,a;c,iJc)^(-DyXi,Y ( i)'S'((^i,M,a;c,i;c) l ll^ i ,n i ) • (3-1) 



Similarly, 



55 1 k + SS 1 ck> 22 E (d,u,xc,yc)^(DUX 1 c Yl,)S((Yl UtXcyc ) l \\Yl Alz ). (3.2) 

From Eg. 13. H and Eg. I3.2l and using Markov's inequality we get a coordinate j outside of C but 
in / such that 

1- ^(d,u,x c ,y c )^(DUXl : Y^)S{{Xl U Xc yc ) j \\X l d . Ui ) < 2 ^ 1 ( !^) ) < 4<fc, and 

2. %^ c ,, c )^(D^^)^(«, M , :cc ,, c ),rj J , Mj .) < 7^ <45c. 
Therefore, 

45c > E(d,u,a:c,yc)^-(£ , ^cy'c)^'((^,ti,a;c,yc)jll^i,fj) 

= ^(d- ] ,U- ] ,x c ,yc)^(D- ] U- ] Xl,Yi)^(d ]: u j )<-(D ] U j )\ (D- j U- ] Xl,Yi) = (d- ] ,U- j ,xc,yc)S(( X d,u,x c ,ych\\ X d :j ,u : i)- 

And, 

4<5c > ^(d, u ,x c ,yc)^{DU x 1 c Yl,)S{{Y} u xc yc ) j\\Y d . U] ) 

= E (d_ 3 ,u_ J .x c ^c)^(-D_ J C/_ 3 Xi,y ( i) E (d J ,« J )4-(D 3 ;7 J )| (I3_jLf_ J X^y^) = (d_ 3 ,«_j,sc,ac)^((^d,«,Kc,yc)jll- 5/ d 3 ,«3)- 

Now using Markov's inequality, there exists set G\ with PrlD^jU-jX^Y^, G G{\ > 1 — 0.2, such 
that for all (d-j,u^j,xc,yc) € G±, 

!• E (dj,Mj)<— (r> 3 c/j) (i3_jLf_ J ^y ( i)=( £ ;_ 3 ,«_j, K c,ac)' S '((^l«,xc,ac).7'll^d 3 ,« J ) ^ 40 ^ c ' and 

2 - %j J ,i 4J )«-(.D, f i/ J )| (i)_ 3 y_ i x^y^)=(d_ J ,«_ 3 ^c,yc)^((^i,u,xc,yc)jll- 5/ d 3! «3'' - 40< ^ c ' 

Fix (d-j,U-j,xc,Uc) G Gi. Conditioning on IX, = 1 (which happens with probability 1/2) in 
inequality [TJ above we get, 

E lJj ^Yi|(D_ J a- 3 ^Y^)=(d_ 3 , tl _ J ,xc,y c )^(( X d_ 3 ,u_ J , w ,x c ^c)jll X w) - 80Sc - ( 3 ' 3 ) 

Conditioning on Z?j = (which happens with probability 1/2) in inequality [21 above we get, 

^x J ^X}\(D^ j U^ j X^,Y^)=(d^ ] ,u. ] ,xc,yc) S (( Y d- ] ,u^ j ,x J ,xc,yc)i\\ Y x 3 ) ^ 8(Wc - ( 3 - 4 ) 
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Let X 2 Y 2 = ((X 1 r 1 ) ti _ 3iU _ j ^ Ciyc ) i . Note that X 2 Y 2 is SM-like for l x. From Eq. ET3] and 
Eq.[32Dwe get that 

crent^,(X 2 y 2 ) + crent£(X 2 F 2 ) < c. 

Hence, 

err / (((X 1 y 1 ) d _. ! „_. )a . Cil/0 ) :/ ) > e. 

This implies, 

Pr[T, = 1| (l,d-j,u-j,x c ,yc) = {TD-jU-jXcYc)] <l-e. 

Therefore overall 

Pr[Tj = 1| (T = 1)] < 0.8(1 - e) + 0.2 < 1 - s/2. 



4 Strong direct product for set disjointness 

For a string x £ {0, 1}™ we let x also represent the subset of [n] for which x is the characteristic 
vector. The set disjointness function disj : {0, 1}™ x {0, 1}™ — > {0, 1} is defined as disj(as, y) = 1 
iff the subsets x and y do not intersect. 

Theorem 4.1 (Strong Direct product for set disjointness) Let k be a positive integer. 
Then R 2 ^ n{k) {A\s] k )=n{k-n). 

Proof: Let n = 41 — 1 (for some integer I). Let T = (T 1; T 2 , 1) be a uniformly random partition 
of [n] into three disjoint sets such that |Ti| = \T^\ =21 — 1 and |/| = 1. Conditioned on 
T = t = (ti,t2, {i}), let X be a uniformly random subset of t\ U {i} and Y be a uniformly 
random subset of t-x U {i}. Note that I o T o 7 is a Markov chain. We show, 

Lemma 4.2 crent 2 ^'(disj, {1}) = f2(n). 

It is easily seen that ess XY (disj, {1}) = 0.75. Therefore using Theorem 13.31 and Lemma \2.2\ we 
have, 

Rt P 2 b n (fc ,(disj fc )-r!(fc.n). 

■ 

Proof of Lemma 14.21 Our proof follows on similar lines as the proof of Razborov showing 
linear lower bound on the rectangle bound for set-disjointness (see e.g. |KN97] . Lemma 4.49). 
However there are differences since we are lower bounding a weaker quantity. 

Let S = l/(200) 2 . Let X'Y' be such that crent£ r [X'Y') + crent£ Y {X'Y') < Sn and X'Y' 
is SM-like for XY. We will show that err disji{1} (X'r') = Pr[disj(X'F') = 0] > 1/70. This will 
show the desired. We assume that Pr[disj(X'F') = 1] > 0.5 otherwise we are done already. Let 
A,B£ {0, 1} be binary random variables such that A <-» X <-» Y <-» B and X'Y' = (XY\ A = 
B = l). 

Claim 4.3 

1. Pt[A = 5 = 1, d\s\(XY) = 0] 

= \^t=(t lM Ai})^T Pr[A = 1| T = t, Xi = 1] Pi[B = l\T = t,Y i = l\. 

2. Pt[A = B = 1, d\s\(XY) = 1] 

= \^t=(t lM ,{i})^T Pr[A = l\T = t,Xi = 0] Pi[B = 1\ T = t,Yi = 0]. 
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Proof: We first show part 1. 

Pr[A = B = 1, d\s](XY) = 0] = Pr[A = B = 1, Xj = Y T = 1] 

= Et=(ti.t2.W)<-T Pr t A = B = I, Xt = Y t = l\ T = t] 

= ®t=( tl ,t2,{i})+-T = Yi = 1| T = t] PrL4 = B = 1| T = i, X, = Y = 1] 

= J E *=( tl ,t 2 ,M)^TPr[A = B = l\T = t,X i = Y i = l] 

= l^tuU.WX-T Pr[A = 1| T = t,Xi = 1] Pr[B = 1| T = t, Y = 1]. 

Now we show part 2. Note that the distribution of (XY\ disj(X, Y) = 1) is identical to the 
distribution of (XY\ Xj = Yj = 0) (both being uniform distribution on disjoint x,y such that 
\x\ = \y\ = I). Also Pr[disj(XF) = 1] = 3Pr[A 7 = Y> = 0]. Therefore, 

Pr[A = B = l,6\s){XY) = 1] = Pr[disj(XF) = 1] Pv[A = B = 1| disj(XY) = 1] 
= 3Pr[A 7 = Fj = 0] PrL4 = B = 1| X/ = Y T = 0] = 3Pr[A = B = 1, Xj = F 7 = 0] 
= 3E t={tut2t{i}) ^ T Pr[A = B = l,X i = 0,Y i = 0\T = t] 

= 3Et=( tl>t2 , {i} )^T Pr[X, = 0, = 0| T = t] Pr[A = B = 1| T = t, X, = 0, Y = 0] 
= ^ t=(tl;t2i{i}) ^ T PrL4 = B = 1| T = t, X t = 0, Y t = 0] 

= ^ t=(tl;t2i{i}) ^ T Pv[A = 1| T = t,Xi = 0] Pr[B = 1| T = t, Y = 0]. 



Claim 4.4 Let = {t 2 | S(X' t \\X t2 ) > lOOSn}, B\ = {^| S{Y(\\Y tl ) > 100<5n}. 

B 2 X = {t\ Pv[A= 1| X, = l,T = t] < ^-PrL4 = 1| Xi = 0,T = t]}. 

i?2 = { t | p T [B = l\Y = l,T = t}< ipr[B = 1| Yi = 0,T = t}}. 

1. PT[A = B = l,T 2 eBi\<^Pv[A = B = l}. 

2. Pv[A = B = l,T 1 eBl]<^ 5 Pv[A = B = l]. 

3. Let t 2 i B\, then Pr[T e T 2 = t 2 ] < y^. 

4. Let h i B\, then Pr[T G 1\ - ^] < T J jJ . 

Proof: We show the proof of part 1. and part 2. follows similarly. Let T" = (T| A = £> = 1). 
Note that X' «• T' <-> Y' is a Markov chain. Also for every (x,y) : (T\ XY = (x,y)) is 
identically distributed as (T'| X'Y' = (x,yj). Consider, 

Sn > E y ^ Y ,S(X' y \\X y ) = E y ^ Y ,S((X'T') y \\(XT) y ) 

> ^(y.t)^{Y'T')S{X' y t \\X y .t) = E t ^ T ,S{X' t \\X t ) = E t2 ^ T2 S(X^ 2 \\X t2 ). 

Therefore using Markov's inequality, 

We show the proof of part 3. and part 4. follows similarly. Fix t 2 ^ B\. Then, 
100^ > S{X' t2 \\X t2 )>J2 S{{Xl a )i\ I (X t2 )A. 

i0 2 
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Let R = {i<£ t 2 \ S{{Xl 2 )i\\(X t2 )i) > 0.01}. From above l -§ < For i <£ RUt 2 , 

s((xi a ) i \\{x ta ) i )<o.oi => \\(x^) i -(x t2 ) i \\ 1 <Vom = o.i 

=> Pr[(^ 2 )< = 1] > 0.4 > i Prpr t ' 2 )i = 0] (since Pr[(X ta )< = 1] = 0.5) 
=> Pr[X £ = 1| T 2 = i 2) A = 1] > lpr[Xi = 0| T 2 = i 2 , A = 1] 

- ^ = 11 Ta = t2] Pr[X, = 1| T 2 = t 2 , A = 1] > ^ = !'I a = ^ W =0| T 2 = i 2 , A = 1] 



Pr[Xi = 1| T 2 = t 2 ] ' ' J " 3 Pr[Xj = 0| T 2 = t 2 ] 

=> PrL4 = 1| X t = 1,T 2 = i 2 ] > ipr[A = 1| X t = 0,T 2 = i 2 ] 

Therefore i R U t 2 implies t = (ii, t 2 , {«}) ^ B^. Therefore, 



Pr[T e Bl\ T 2 = t 2 ] < Pr[z e i?| T 2 = t 2 ] = H < _L. 



Claim 4.5 1. Let Bad\ = 1 iff T 2 e otherwise 0. Tften 

E t=(tl;t2i{i}) ^ T PrL4 = 1| = 0,T = t] Pr[L? = 1| 5* = 0,T = i]B<w£ 

< T ^E t=(tlit2i{i}) ^ T Pr[A = l| X = 0,T = t]Pr[B = l| Y l= Q,T = t}. 

2. Let Bad\ = 1 iffT x EB\ otherwise 0. TTien 

E t=(tl;t2i{i}) ^ T Pr[A = l\Xi=0,T = t] Pv[B = 1| ^ = 0,T = i]BodJ 

< T ^E t=(tlit2i{i}) ^ T Pr[A = l| X i = 0,T = i]Pr[B = l| F i= 0,T = i]. 

5. Fix t 2 ^B\. Let T t2 = (T| T 2 = t 2 ). Let SacZ^ = 1 iff T e B 2 X otherwise 0. Then 
E t=(tl , t2;{i} )^T t2 Pr[A = 1| Xi = 0,T = i]Pr[fl = 1| Yi = 0,T = i]Bad£ 

< ^ E t=(tut 2 ,{i})^T t2 Pr[A = l| X i = 0,T = t]Pr[S = l| K t =0,T = t]. 

4. Fix t x ^B\. Let T tl = (T| Ti = ti). Let Bad£ = 1 iff T E By otherwise 0. Tften 
E t=(tl , t2){i} )^T tl Pr[A = 1| X = 0,T = t]Pv[B = 1| Y 4 = 0,T = i]Bad£ 

< Y^ E *=(*i.*2,«)=T tl PrL4 = l| X i = 0,T = t]Pr[B = l| Y=0,T = t]. 
Proof: We show part 1. and part 2. follows similarly. Note that for all t, 

Pr[A = l\T = t) =Pr[Xj = 0| T = t] PrL4 = 1| X = 0,T = <] 

+ Pr[X = 1| T = t]Pv[A=l\ Xi = l,T = t]. 
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Hence Pi[A = 1| T = t] > \ Pv[A = 1| X> = 0,T = t}. Similarly Pi[B = 1| T = t] > \ Pv[B = 
1| Yi = 0,T = t\. Consider, 

E t=(*i,*2,«)^T Pr[A = 1| Xi = 0, T = t] Pr[B = 1| = 0, T = i]Ba(£ 

< 4E i=(tl , i2;{i}) ^ T Pr[A = 1 1 T = t] Pr[B = 1| T = t]Ba<4 

= 4E 4=(il ,t 2i{i}) ^ T PrL4 = B = l\T = t]Badl 

= 4Px[A = B = l,T 2 €Bl] 
4 

< — Pr[A = B = 1] (from Claim [O} 

< ^ Pr[A = B = 1, disj(XT) = 1] (since Pr[disj(X'F') = 1] > 0.5) 

= A Et=(ti t2 {l}) ^ T Pr[A = 1| T = t,Xi = 0]Pr[S = 1| T = t, Yi = 0] (from Claim WM 

We show part 3. and part 4. follows similarly. Note that : 

1. Pr[_B = 1| Yi — 0,T = (ti,*2) {*})] i s independent of i for fixed i 2 - Let us call it c(t 2 ). 

2. Pr[^4 = 1| T = (ti,t 2 , {«})] is independent of i for fixed t 2 . Let us call it r(t 2 ). 

3. Distribution of (X\ T 2 = t 2 ) is identical to the distribution (X\ T 2 = t 2 ,Xj = 0). Hence 
E t = (il) t 2){i })^T t2 Pr[A = 1| T = t] = E t=(tl , t2 , {i}) ^ Tt2 Pr[A = 1| Xj = 0, T = i]. 

Fix t 2 <£ B\. Consider, 

E *=(*i,*2,M)^T t2 Pr[A = 1| X t = 0,T = *]Pr[B = 1| = 0,T = t]Bad 2 x 

= c(t 2 )E t=(tut2Al}) ^ Tt2 Pr[A = l\Xi=Q,T = t]Bad 2 x 

< 2c(t 2 )E t=[tut2!{i}) ^ Tt2 Pv[A = 1| T = t]Bad£ 

= 2c(t 2 )r(t 2 )E t= ( tlit2i{i} ) < _ T42 Ba^ 
2 

< — c(t 2 )r(t 2 ) (from Claim H2) 
2 



100 c(t 2 )E t=(tl , t2 , {i}) ^ Tt2 PrL4 = 1| T = t] 
2 



_c(t 2 )E t=(tlit2 , {i}) ^ Tt2 PrL4 = 1| X, =0,T = t] 



2 E t=(tl)t2 , w) ^ Tt2 PrL4=l| X i = 0,T = *]Pr[B = l| = 0,T = i]. 



100 



We can now finally prove our lemma. Let Bad = 1 iff any of Badl,Bad y ,Bad 2 ,Bad 2 is 1, 
otherwise 0. 

Pr[A = B = l,disj(Xy) = 0] 

= ~E t=(tljt2i{i}) <_ T Pr[4 = 1| T = t,Xi = l]Pr[5 = 1| T = t,Y l = 1] (from Claim[L3]) 

> ^E t=(tlM ^ }) ^ T Pt[A = l\T = t,Xi = l] Pv[B = 1| T = t,Yi = 1](1 - Sad) 

> — E t=(tl , t2 , {i}) ^ r PrL4 = l| T = t,X i =0]Pr[B = l| T = t, = 0](1 - Bad) 

84 

> 3gooEt=(ti,t 2 ,{i})4-rPr[A = l| T = t, X, = 0] Pr[B = 1| T = t,Y = 0] (from Claim EB 

7 

= — PrL4 = B = 1, disj(Xr) = 1] (from Claim \4~3$>- 

Z.ZD 
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This implies 



Pr[disj(X'F') = 0] = Pr[disj(AY) = 0| A = B = 1] 
_ Pr[disj(AY) =0,A = B = 1] 
~~ Pr[A = B = 1] 

J7_ Pr[disj(Xr) = 1, A = B = 1] 
~ 225 Pr[A = B = 1] 

= ^.p r[ disj(^) = l]>^. 
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